UTILITY MAXIMIZATION WITH A STOCHASTIC CLOCK AND 
AN UNBOUNDED RANDOM ENDOWMENT 



GORDAN ZITKOVIC 

Abstract. We introduce a linear space of finitely additive measures to treat 
the problem of optimal expected utility from consumption under a stochastic 
clock and an unbounded random endowment process. In this way we estab- 
lish existence and uniqueness for a large class of utility maximization prob- 
lems including the classical ones of terminal wealth or consumption, as well 
as the problems depending on a random time-horizon or multiple consump- 
tion instances. As an example we treat explicitly the problem of maximizing 
the logarithmic utility of a consumption stream, where the local time of an 
Ornstein-Uhlenbeck process acts as a stochastic clock. 

1. Introduction 

When we speak of the expected utihty, we usually have one of the follow- 
ing two cases in mind: expected utility of consumption on a finite interval, or 
the expected utility of terminal wealth at some future time point. These two 
cases correspond to the two of the historically most important problem formu- 
lations in the classical calculus of variations and optimal (stochastic) control - 
the Meyer formulation L[s,x{s))dt\ — + max and the Lagrange formulation 

E[-!/)(x(r))] max, where x{-) denotes the controlled state function or stochastic 
process, and L and i/j correspond to the optimization criteria. These formulations 
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owe a great deal of popularity to their analytical tractability; they fit very well 
into the framework of the dynamic programming principle often used to tackle 
optimal control problems. Even though there is a number of problem formula- 
tions in the stochastic control literature that cannot b e reduced to either a M eyer 
or a Lagrange form (see Section 2.7, pages 85-92 of lYong and Zhoul (jl999f ). for 
an overview of several other classes of stochastic control models), the expected 
utility theory in contemporary mathematical finance seems to lag behind in this 
respect. The introduc tion of convex duality into the treatment o f util ity maxi 
mization problems by iKaratzas et al.l (119871) and 



as its f urther development in 



Karatzas et al 



Kramkov and Schachermaver 



(1999L 



1991). as well 



Cvitanic et al 



Hugonnier and Kramkov 



2003) (to hst 



(|2001[ ). IKaratzas and Zitkovid (|2003f) and 
but a small subset of the existing literature) give hope that this lag can be overcome. 

This paper aims at formulating and solving a class of utility maximization prob- 
lems of the stochastic clock - type in general incomplete semimartingale market 
with locally bounded stock prices and a possibly unbounded random endowment 
process. More specifically, our objective is to provide a mathematical framework 
for maximizing functionals of the form E.[JI^ U{uj,t,ct) dnt], where [/ is a time- 
and uncertainty-dependent utility function (a utility random field), ct is the con- 
sumption density process, and Kt is an arbitrary non-decreasing right-continuous 
adapted process on [0,T] with kt — I- Two particular choices Kt — t/T, and 
Kf = \{t=T} correspond to the familiar Meyer and Lagrange formulations of the 
utility maximization problem, but there are many other financially feasible ones. 
The problems of maximization of the expected utility at terminal time T, when T 
is a stopping time denoting the retirement time or a default time, form a class of 
examples. Another class consists of problems with the compound expected utility 
sampled at a sequence of stopping times. Furthermore, one could model random 
consumption prohibition by setting Kt = Ij/f^gc'} du for some index process Rt 
and a set C C K. 

The notion of a stochastic clock has already been explicitly present in|( 



GoU and Kallsen 



( 2003) (where t he phrase stoc hasti c clock has been introduced) , and implicitly in 



Zitkovid (|l999t ). IZitkovicl(|2002l ) and lKaratzas and Zitkovid (120031 ) 



GoU and Kallsen 



( 20031 ) treat the case of a logarithmic utility with no random endow ment process 



Karatzas and Zitkovic 



under additional assumptions on existence of the optimal dual process. 
(|2003[ ) establish existence and uniqueness of optimal consumption process in an in- 
complete semimartingale market in the presence of a bounded random endowment 
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Their version of the stochastic clock is, however, relatively limited - it is required 
to be a deterministic process with no jumps on [0,r). This assumption was cru- 
cial for their treatment of the problem using convex duality, and is related to the 
existence of a cadlag version of the optimal dual process. R elated to the notion of 



a stochastic clock is the work 



Blanchet-Scalliet et al 



([20031), which deals with the 



utility maximization on a random horizon not ne cessarily given by a stopping time. 
Also, recent work of iBouchard and PhamI (|2003r ) treats the wealth-path dependent 
utility maximization. The authors use a duality relation between the wealth pro- 
cesses and a suitably chosen class of dual processes viewed as optional measures on 
the product space [0, T] x ft. 

In the present paper we extend the existing literature in several ways. We prove 
existence and describe the structure of the optimal strategy under fairly unrestric- 
tive assumptions on the financial market and the random endowment process. 

First, we allow for a general stochastic clock and a general utility satisfying the 

appro priate version of the requirement of reasonable elasticity of lKramkov and Schachermavei 

Second, we allow a random endowment process that is not necessarily bounded, 
we only require a finite upper-hedging price for the total endowment at time t = 
T . The case of a non-bounded random endowment in the utih ty maximization 



literature has been considered in 



Hugonnier and Kramkovl ([2002), but only in the 



case of the utility of terminal wealth, and using techniques different from ours. 
The only restriction warranting discussion is the one we place on the jumps of the 
stock-price process S. Namely, we require S to be locally bound ed. The reason 
fo r this requirement (not present in iKaratzas and Zitkovid (|2003^ . but appearing 



Hugonnier and Kramkovl (|2002h ) is that the random endowment process is not 



assumed to be bounded anymore, and the related notion of acceptability (developed 
only in the locally-bounded setting) has to be employed. 

Finally, we present an example in which we deal completely explicitly with a 
utility maximization problem in an Ito-process market model with constant coef- 
ficients where the stochastic clock is the local time at of an Ornstein-Uhlenbeck 
process. This example illustrates how the uncertainties in the future consump- 
tion prohibitions introduce the incompleteness into the market, and describes the 
optimal strategy to face them. 

In order to tackle the problem of utility maximization with the stochastic clock 
we cannot depend on existing techniques. We still use the convex-duality approach. 
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but in order to formulate and solve the dual problem we introduce and study the 
properties of two new Banach spaces - one of consumption densities and the other 
of finitely-additive measures. Also, we simplify the formulation of the standard 
components of the convex-duality treatment by defining the dual objective function 
directly as the convex conjugate of the primal objective function in the suitably 
coupled pair of Banach spaces. In this way, the mysterious regul ar parts of the 
f initel y-add itive counterparts of the mar tingale measures used in 



Cvitanic et al 



(j200ll ) and iKaratzas and Zitkovid (|2003l ) in the definition of the dual problem, 



appear in our treatment more naturally, in an a posteriori fashion. 

The paper is organized as follows. After this Introduction, Section 2. describes 
the model of the financial market and poses the utility maximization problem. In 
Section 3. we introduce the functional- analytic setup needed for the convex-duality 
treatment of our optimization problem. Section 4. introduces the convex conjugate 
of the utility functional and states the main result. An example admitting an 
explicit solution is treated in Section 5. Finally, Appendix A contains the proof of 
our main result. 

2. The Financial Market and the Optimization Problem 

2.1. The Stock-price Process. We consider a financial market on a finite horizon 
[0,T], T G (0,oo), consisting of a d-dimensional locally bounded semimartingale 
(S't)tg[o,T] = {S}, . . . , S'l)t£[{),T]- The process {St)t£[o,T\ is defined on a stochastic 
base {^l^T, {!Ft)te[vi.T]^^) satisfying the usual conditions. For simplicity we also 
assume that JFq is P-trivial and that T = Tt- Together with the stock-price process 
(S't)tg[o.T] J there is a numeraire asset , and all values will be denominated in terms 
of Si- This amounts to the standard assumption that (S'f)ig[o,T] is equal to the 
constant process 1. 

2.2. Admissible Portfolio Processes. A financial agent invests in the market 
according to an (jFt)jg[o^T]-predictable S'-integrable d-dimensional portfolio pro- 
cess (i7t)(g[o^T]- The stochastic integral {{H ■S)t)t£[o,T] is called the gains process 
and represents the net gains from trade for the agent who holds a portfolio with 
H^ shares of the asset k at time for k = 1, . . . , d. 

A portfolio process {Ht)t£[o,T\ is called admissible if there exists a constant 
a; S M such that x + {H ■ S)t > for all t e [0, T], with probability 1. Furthermore, 
an admissible process (iJ)tg[o_T] is called mzLximal admissible if there exists no 
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other admissible process (^^)tG[o,T] such that 

{H ■ S)t < {H ■ S)t a.s., and F[{H ■ S)t < [H ■ S)t] > 0. 

The family of all processes (X/^)j£[o^t] of the from Xf^ = {H-S)t , for an admissible 
H, will be denoted by X. The class of processes (X/^)jg[o^T] G ^ corresponding to 
maximal admissible portfolio processes (iJ)ig[o,T]j will be denoted by A'max- 

We complement the wide-sp read notion of admissibility by the l ess- known notion 



of acceptability (introduced in lDelbaen and Schachermaven (|1997l )) because admis- 



sibility is not adequate for dealing with non-bounded random endowment processes, 
as it has been shown in the context of utility maximization from terminal wealth 



in lHugonnier and Kramkovl (|2002r ). A portfolio process (iJ)jg[o_T] is called accept- 
able if it admits a decomposition H — iJ+ — with 7?+ admissible and 
maximal admissible. 

2.3. Absence of Arbitrage. In order to rule out the arbitrage opportunities in 
our market, we state the following assumption 

Assumption 2.1. There exists a probability measure Q on equivalent to P, 
such that the process {St)t£[o,T] is a Q-local martingale. 



It has been shown in the celebrated paper of lDelbaen and Schachermaven (| 1994 ). 
that the condition in Assumption 12.11 is equivalent to the notion of No Free Lunch 
With Vanishing Risk (NFLVR) - a concept closely related to, and only slightly 
stronger than the classical notion of absence of arbitrage. The condition NFLVR 
is therefore widely excepted as an operational proxy for the absence of arbitrage, 
and the Assumption 12.11 will be in force throughout the rest of the paper. 

The set of all measures Q ~ P as in Assumption 12.11 will be denoted by A4 , and 



we will refer to the elements of A4 as the equivalent local martingale measures. 

2.4. Endowment and Consumption. Apart from being allowed to invest in the 
market in an admissible way, the agent 

(a) is continuously getting funds from an exogenous source (random endow- 
ment), and 

(b) is allowed to consume parts of his wealth as the time progresses. 
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These capital in- and out-flows are modelled by non-decreasing processes i£t)te[o,T] 
and {Ct)te[o,T] in V, where V denotes the set of all cadlag (J^t)(g[o,T]-optional pro- 
cesses vanishing at whose paths are of finite variation. Here, and in the rest of the 
paper, we always identify P-indistinguishable processes without explicit mention. 

The linear space V can be given a structure of a vector lattice, by equipping it 
with a partial order ^, compatible with its linear structure: we declare 

^ if the process (F^ — -F/)te[o.T] has non-decreasing paths. 

The cone of all non-decreasing processes in V is the positive cone of the vector 
lattice V and wc denote it by V+. Also, the total variation process (|F| t)te[o,T] € 
V+ is associated with each F e V. 

The process introduced in (a) above and denoted by {£t)te[a.T] ^ V+ represents 
the random endowment, i.e. the value £t at time t G [0,T] stands for the 
cumulative amount of endowment received by the agent during the interval [0,t\. 
The process {£t)te[o,T] is given exogenously, and we assume that the agent exerts no 
control over it. On the other hand, the amount and distribution of the consumption 
is decided by the agent, and we model the agent's consumption strategy by the 
consumption process (Ct)te[o,T] S V+; the value Ct is the cumulative amount 
spent on consumption throughout the interval [0, t] . We will find it useful in the 
later sections to interpret the processes in V+ as optional random measures on the 
Borel sets of [0,T]. 

2.5. Wealth Dynamics. Starting from the initial wealth of a; e IR (which can 
be negative) and the endowment process {£t)te[o,T\^ our agent is free to choose an 
acceptable portfolio process (-f^t)fe[o,T] and a consumption process {Ct)te[o,T] S V+. 
These two processes play the role of the controls of the system. The resulting 
wealth process (-^t^'^''"^)te[o,T] is given by the wealth dynamics equation 

Xl""'"'^^ ^x + {H-S)t-Ct + £u te[Q,T]. (2.1) 

A consumption process (C)tg[o,T] G V+ is said to be (a;, f)-financeable if there 
exists an acceptable portfolio process (^f)te[o,T] such that X^f'^'*^^ > a.s. The 
class of all (a;, £)-financeable consumption processes will be denoted by A{x,£), or 
simply by A{x), when there is no possibility of confusion. 

Remark 2.1. The introduction of the concept of financeability which suppresses the 
explicit mention of the portfolio process (iJt)te[o,T] ; will be justified later when we 
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specify the objective (utility) function. It will depend only on the consumption and 
not on the particular portfolio process used to finance it, so we will find it useful 
to formulate a static version of the optimization problem in which the portfolio 
process (-fft)te[o.T] will not appear at all. 

Remark 2.2. The notion of financeability imposes a weak solvency restriction on 
the amount of wealth the agent can consume: even though the total wealth process 
{Xf^'^''"^)t,^[o,T] is allowed to take strictly negative values before the time T, the 
agent must plan the consumption and investment in such a way to be able to pay 
all the debts by the end of the planning horizon with certainty. In other words, 
borrowing is permitted, but only against the future endowment so that there is no 
chance of default. With this interpretation it makes sense to allow the initial wealth 
X to take negative values - the initial debt might very well be covered from the future 
endowment. Fina lly, we stress that our notion of financ eability differs from the 
one introduced in IEI Karoui and Jeanblanc-Picaug (|l998r) . where no borrowing is 



allowed. A treatment of a consumption problem with such a stringent financeability 
condition seems to require a set of techniques different from ours and we leave it 
for future research. 

2.6. A Characterization of Financeable Consumption Processes. In the 

treatment of our utility-maximization problem in the main body of this paper, 
the so-called budget-constraint-characterization of the set A{x) will prove to be 
useful. The idea is to describe the financeable consumption processes in terms of 
a set of linear inequalities. We provide such a characterization it in the following 
proposition under the assumption that the random variable £t (denoting the total 
cumulative endowment over the horizon [0,T]) admits an upper-hedging price, 
i.e. 1({£t) = supQg^ E^[£t] < oo. 

Proposition 2.2. Suppose that the total endowment £t admits an upper-hedging 
price, i.e. IA{Et) < oo. Then, the process {Ct)t£[o,T] S V+ is (x^S)- financeable if 
and only if 

E^[Ct]<x + E^[£t], yQe M. (2.2) 

Proof. " only if ": Assume first that {Ct)telo.T] G -^{xjE), and pick an acceptable 
portfolio process (fft)te[o.T] such that the wealth process (A"j^'^''^'')fg[o.T] defined 
in (|2.ip satisfies xi^'^'*^^ > a.s. By the definition of acceptability, there exists a 
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decomposition H = — H- into an admissible and a maximal admissible H- 
portfolio processes. Let M' be the set of all Q e M such that {{H^ ■ S)t)te[o,T] is 
a Q-uniformly integrable martingale. For any Q E A4 the process {{H~^ ■ S')t)te[o,T] 
is a Q-local martingale bounded from below, and therefore a Q-supermartingale. 
Hence, {{H ■ S)t)te[o,T] is a Q-supermartingale for all Q £ A4' and 



(2.3) 



<x + E^[£t] - E^ICt], for all Q e M' . 
The set A4' of all Q e such that • 5* is a Q-unifo rmly integrable martingale is 



convex and dense in A4 in the total variation norm (see 



Delbaen and Schachermaver 



(jl997[ ). Theorem 5.2). Therefore, the claim follows from (|2.3p and the density of 
M' inM. 

"if": Let {Ct)t(£[o,T] G V+ be a process satisfying Eq[Ct] < a; + Eq[£t] for all 
Q E Ai. Since £t > admits an upper- hedging price, there exists a constant p > 
and a maximal admissib le portfolio process (ff^)tp[n/r ] such that p+ (H^ ■ S)t > £t 
a.s. (see Lemma 5.13 in lDelbaen and Schachermaveii (jl998t )). Define the process 

Ft = esssup Eq[Ct -£t+P+{H^ ■ ^)T|^t], 

and note that Fq < x + p. {Ft)te[o,T] is a nonn egative Q- s uperm artingale for all 
e A4, permitting a cadlag modification fsee iKramkov ( 19961), Th eorem 3.2), 



and thus the Optional Decomposition Theorem (see iKramkovl (|l996( l. Theorem 
2.1) asserts the existence of an admissible portfolio processes (fff )tg[o,T] and a 
finite- variation process (Gt)tg[o,T] G V+ such that 

(i?^ • S)t - Gt, for aU t € [0,T], a.s. 



Ft — Fn 



If follows that 



-p+{H^ ■S)t>Ct~£j 



) + {H^ ■ S)t, so for the acceptable 
portfolio process (^^t)te[o,T]j defined by Ht = — Hf we have x + {H ■ S)t — 
Ct+£t>0- □ 



2.7. The Utility Functional and the Primal Problem. In order to define the 
objective function of our optimization problem, we need two principal ingredients: 
a utility random field and the stochastic clock process. 

Th e noti on of a utility random field a s defined below has appeared in IZitkovic 



([19991) and iKaratzas and Zitkovid (j2003l ). and we use it because of its fiexibility 
and good analytic properties - there are no continuity requirements in the temporal 
argument, and so it is well suited for our setting. 
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As for the notion of a stochastic clock, it models the the agent's (either endoge- 
nously or exogenously imposed) notion of passage of time with respect to which the 
consumption rate is being calculated and utility accumulated. Several examples 
often appearing in mathematical finance will be given below. Before that let us 
give the formal definition of the concepts involved: 

Definition 2.3. 

(1) A utility random field U : n x [0,T] x (0, oo) ^ M is an T (g) B[0, t] (g) 
B{0, oo) - measurable function satisfying the following conditions. 



(a) For a fixed G ^x [0, T], the function x t-^ U{uj,t,x) is a utility 
function, i.e. a strictly concave, increasing C^'^-function satisfying the 
Inada conditions: 

lim Uxiuj^t, x) — oo and lim Ux{Lo,t^x) = Q, a.s, 

where Uxi-,-,-) denotes the derivative with respect to the last argu- 
ment. 

(b) There are continuous, strictly decreasing (non-random) functions Ki : 
(0,00) (0,00), i = 1,2 satisfying limsup^^^^ $r[fy ^ ^-"^"^ 
stants G < D E M. such that we have 



for aU (t, uj) e [0, T] x ft. 

(c) For every optional process {ct)telo,T], the process {U{u!,t,ct))t£[o.T] is 
optional. 

(d) U is reasonably elastic, i.e. it satisfies AE[J7] < 1, where AE[[/] 
denotes the asymptotic elasticity of the random field U, defined by 



(2) The stochastic clock {K.t)teio,T] is an arbitrary process in V+, such that 
kt — 1, a.s. 

Remark 2.3. The requirement kt — ^ in the definition above is a mere normaliza- 
tion. We impose it in order to be able to work with probability measures on the 
product space [0, T] x f2 (see Section |3l) 



Ki{x) < Ux{uj,t,x) < K2{x), 



for aU (cj, t,x) eflx [0, T] x (0, 00), and 



G < U{uj,t,l) < D 
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We are now in the position to define the notion of a utility functional which 
takes consumption processes as arguments and returns their expected utihty. This 
expected utihty (as defined below in l2.4p will depend only on the part of the con- 
sumption process iCt)telo.T] admitting a density with respect to the stochastic 
measure dn, so that the choice of a consumption plan with a nontrivial component 
singular to dn would be clearly suboptimal. For that reason we restrict our at- 
tention only to consumption processes {Ct)t£[o.T] whose trajectories are absolutely 
continuous with respect to dK, i.e. only processes of the form Ct = /J Ct dnt, for a 
nonnegative optional process {ct)teio.T] which we will refer to as the consumption 
density of the consumption process (Ct)jg[o,T]- For simplicity, we shall assume 
that the random endowment admits a d^-density {et)ti£[o,T] in that £t — Jq &u duu, 
for all t £ [0, T], a.s. This assumption is clearly not necessary since the restrictions, 
which the size of the random endowment places on the choice of the consumption 
process, depend only on the value £t, as we have shown in Proposition 12.21 We 
impose it in order to simplify notation by having all ingredients defined as elements 
of the same Banach space (see Section [3l) 

The utility derived from a consumption process should therefore be viewed as a 
function of the consumption density {ct)te[o,T] and we define the utility functional 
as a function on the set of optional processes: 

U(c) = E / U{uj,t,ct) dnt, for an optional process (cf)tg[o.T]- (2-4) 

To deal with the possibility of ambiguities of the from (-fcx)) — (— oo) in the definition 
above, we adopt the following convention, standard in the utility-maximization lit- 
erature: when the integral E {U{uj, t, ct)) dut of the negative part (U{lj^ t, ct)) 
of the integrand from (|2.4p takes the value — oo, we set U(c) — —oo. In other words, 
our financial agent is not inclined towards the risks that defy classification, as far 
as the utility random field U is concerned. Finally, we add a mild technical inte- 
grability assumption on the utility functional U. It is easily seen to be satisfied by 
all our examples, and it is crucial for the simplicity of the proof of Proposition [4T] 

Assumption 2.4. For any nonnegative optional process {ct)tGlo,T] such that U(c) > 
— oo and any constant < (5 < 1 we have \J{Sc) > —oo 

2.8. Examples of Utility Functionals. 

Example 2.5 (Utility Random Fields). 
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(1) Let U{x) be a utility function satisfying limsup^^^p ^uix)' ^ ^1^°; 
suppose there exist functions A : (0, oo) M and B : (0, oo) (0, oo) 
such that U{Sx) > A{S) + B{5)U{x), for all 5 > and a; > 0. A family of 
examples of such utility functions is supplied by the HARA family 

U^{x) = i 

\\og{x) 7 = 0, 

Then, the (deterministic) utility random field 
U{uj,t,x) = exp{—(3t)Uj{x) 

conforms to Definition 12.31 and satisfies Assumption 12.41 

(2) If we take a finite number n of (jFf )tg[o.T]-stopping times ti, . . . , r^, positive 
constants f3i, . . . ,(3n and n utility functions C/^ (•),..., [/"(•) as in (1) and 
define 

n 

U{uj,t,x) = ^exp(-/3jt)J7*(a;)l{t=nM}, 
1=1 

the random field U can be easily redefined on the complement of the union 
of the graphs of stopping times r^, i = 1, ... ,n to yield a utility random 
field satisfying Assumption 12.41 

Example 2.6 (Stochastic clocks I). 

(1) Set = i, for t < T = 1. The utility functional takes the from of utility 
of consumption U(c) ~ E U{uj^ t, ct) dt. 

(2) For Kf = for t < T, and = 1, we are looking at the utility of terminal 
wealth E,[U{Xt)], where U{x) = U{u!,T,x). Formally, we would get an 
expression of the form U(c) = M[U{u!,T,ct)], but clearly ct — Xt in all 
but suboptimal cases. 

(3) A combination Kt ~ t/2 ior t < T = 1, and kt — 1, of the two cases 
above models the utility of consumption and terminal wealth U(c) — 
E[J^U{u;,t,ct)dt + U{XT)]. 

Example 2.7 (Stochastic clocks II). 

(1) Let r be an a.s. finite (jFt)tg[o^T]-stopping time. We can think of r as 
a random horizon such as the retirement time, or some other market-exit 
time. Then the stochastic clock Kt ~ 0, for t < t, and Kt = 1 for t > t, 
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models the expected utility E[?7(Xt-)] of the wealth at a random time 

T. The random endowment £t has the interpretation of the retirement 
package. In the case in which the random horizon r is unbounded, it will 
be enough to apply a deterministic time-change to fall back within the reach 
of our framework. 

Remark 2.4. As the anonymous referee points out, the case of a random 
horizon t given by a mere random (as opposed to a stopping) time can be 
included in this framework by defining k as the conditional di s tribut ion of 



T, given the filtration {J't)t£[Q,T], as in iBlanchet-Scalliet et al.l ([20031) 



(2) The example in (1) can be extended to go well with the utility function 
from Example 12.51 (2). For an n-tuple of (.Ft)tg[o,T]-stopping times, we set 



n 



II-l{t>n}' 



SO that 



1 " 

U(c) = - VE[exp(-Ar,)C/'(c,J]. 

n ^ — ^ 



n 
1=1 



(3) if we set = 1 — exp(— /?<) for t < t and Kt = I, for t > t, we can add 
consumption to the example in (1) 

U(c) =E[[ exp{^/3t)U{uj,t,ct) dt + {1 - exp{-(3T))U{Xr)], 
Jo 

modelling the utility from consumption up to- and the remaining 
wealth at the random time r. The possibly inconvenient factor (1 — 
exp(— /3r)) in front of the terminal utility term can be dealt away with by 
absorbing it into the utility random field. 

Example 2.8 (Stochastic clocks, IV). 

(1) In this example we model the situation when the agent is allowed to with- 
draw the consumption funds only when a certain index process Rt satisfies 
Rt G C, for some Borel set C C M. In terms of the stochastic clock k, we 
have Kt — min( (it, 1). The Rt could take a role of a political 
indicator in an unstable economy where the individual's funds are under 
strict control of the government. Only in periods of political stability, i.e. 
when Rt G C, are the withdrawal constraints relaxed and we are allowed 
to withdraw funds from the bank. It should be stressed here that the time 
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horizon in this example is not deterministic. It is given by the stopping 
time 

inf ■! i > : / lsR,,(zn\ du > 1 



(2) An approximation to the situation in (1) arises when we assume that the 
set C is of the form {—e,e) for a constant e > 0. If e is small enough 
the occupation time Ij^^gc"} du can be well approximated by the scaled 
local time of the process Rt at 0. Thus, we may set Kt = 1 A if . An 
instance of such a local-time driven example will be treated explicitly in 
Section El 

2.9. The Optimization Problem. Having introduced the notion of the utility 
functional, we turn to the statement of our central optimization problem and we 
call it the Primal Problem. We describe it in terms of its value function u : M ^ K 
as follows 

u{x) = sup U(c), x e IR, C2 5) 

where A{x) denotes the set of all dn- densities of (x, £)-financeable consumption pro- 
cesses. Since we shall be working exclusively with consumption processes admitting 
a dK-density, no ambiguities should arise from this slight abuse of notation. In or- 
der to have a non-trivial optimization problem, we impose the following standard 
assumption: 

Assumption 2.9. There exists a constant x > such that u{x) < oo. 
Remark 2.5. 

(1) The Assumption l2.9l is. of course, non-trivial, although quite common in the 
literature. In general, it has to be checked on a case-by-case basis. In the 
particular case, when the stock-price process is an Ito process on a Brownian 
filtration with bounded coefficients, the Assumption 12.91 is satisfied when 
there exist constants M > and A < 1 such that 

< U{t,x) < M{l + x^), for all {t,x) e [0,T] x (0,oo). 



For reference see 



Karatzas and Shrevd (jl998() . p. 274, Remark 3.9. 



(2) Part (jlbp of the Definition [23] of a utility random field implies that U(c) E 
(— cxd,cxd) for any constant consumption process (ct)te[o,T]i i-e. a process 
{ct)te[o,T] such that Ct = x for some constant x > 0. It follows that u{x) > 
— oo for all X > 0. 
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3. The Functional-Analytic Setup 

In this section we introduce several linear spaces of stochastic processes and 
finitely- additive measures. They will prove indispensable in the convex-duality 
treatment of the optimization problem defined in (j2.5|) . 



3.1. Some Families of Finitely- Additive Measures. Let O denote the <j- 
algebra of optional sets relative to the filtration {J^t)te[Q,T]- A measure Q defined 
on J^Ti and absolutely continuous to P induces a measure Q„ on O, if we set 

lA{t,uj)dKt, for AeO. (3.1) 



[A] =E^ f 
Jq 



For notational clarity, we shall always identify optional stochastic processes {ct)t^[o,T] 
and random variables c defined on the product space [0, T] x measurable with 
respect to the optional cr-algebra O. Thus, the measure can be seen as acting 
on an optional processes by means of integration over [0, T] x i7 in the Lebesgue 
sense. In that spirit we introduce the following notation 



(c,Q> ^ cdQ, (3.2) 

j[o,T]xn 

for a measure Q on the optional ct- algebra O, and an optional process c whenever 
the defining integral exists. A useful representation of the action (c, Qk) of on 
an optional process {ct)t£[o,T] is given in the following proposition. 

Proposition 3.1. Let Q be a measure on Tt, absolutely continuous with respect 
to P. For a nonnegative optional process {ct)te[o.T] we have 

(c,Q,> / CtYPdKt, 







where {yt^)te[o.T] is the cadlag version of the martingale (IE[^|^t])te[o. 



Tl 



Proof. Define a nondecreasing cadlag process (Ct)tg[o,T] , by Ct = /q c„ dn^- By the 
integration-by-parts formula we have 

Y^c.= rY?_dCt + r ct-dY^+ ^y?^ct^ rY^^dCt + r ct^dY^, 

JQ Jo 0<t<T " " 



for every stopping time t < T. By (jProtteii (|l990l) . Theorem III. 17, page 107), 
the process (/p C„_ '^^i^)t6[o,T] is a local martingale, so we can find an increasing 
sequence of stopping times (T„)„gN, satisfying P[r„ < T] — + 0, as n — > oo, such 
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that E JiJ" Ct- dY^ — 0, for every n £ N. Taking expectations and letting n oo, 
Monotone Convergence Theorem imphes that 

(c, Q*^) = eQ[Ct] = E[Y^Ct] - Urn E / " Y^ dCt^E [ Yp dCt 

CtY^dKf 

□ 

Remark 3.1. Note that the advantage of Proposition 13. II over an invocation of the 
Radon-Nikodym theorem is in the fact that the version obtained by the Radon- 
Nikodym derivative is merely optional, and not necessarily cadlag . 

We define = {Qk : Q £ M}. The set M^. corresponds naturally to the 
set of all martingale measures in our setting, and considering measures on the 
product space [0, T] x instead of the measures on J-'t is indispensable for utility 
maximization with stochastic clock. Most of the existing approaches to optimal 
consumption start with equivalent martingale measures on J-'t and relate them the 
to stochastic processes on {J^t)telo,T] through some process of regularization. In our 
setting, the generic structure of the stochastic clock {Kt)t£[Q,T] renders such a line 
of attack impossible. 

However, as it will turn out, A^^ is too small for duality treatment of the utility 
maximization problem. We shall need to enlarge it so as to contain finitely-additive 
along with the countably additive measures. To make headway with this enlarge- 
ment, we consider the set of all bounded finitely-additive measures Q on O, such 
that Pk[A] = implies Q[^] = 0, and we denote this set by ba(0,P„). It is well 
known that ha{0, P^), supplied with the total- variation norm, constitutes a Banach 
space which is isometr i cally iso morphic to the topological dual of L°°(0 , Pk) (see 



Dunford and Schwartz! (|l988^ or lBhaskara Rao and Bhaskara Rad (|l983h ). The ac 



tion of an element Q £ ba(0,P„) on c e L°°(0,P«) will be denoted by (c,Q) - a 
notation that naturally supplements the one introduced in (j3.2p 

On the Banach space ha{0,P^ ) there is a canonical partial ordering transferred 
from the pointwise order of L°°(C',Pk), equipping it with the structure of a Banach 
lattice. The positive orthant of ha{0,Fi^) will be denoted by ha{0,PK.)+- An 
element Q £ ba(C',PK)+ is said to be purely finitely-additive or singular if 
there exist no nontrivial countably additive Q' £ ba(C',PK)+ such that < 
for all ^ e C It is the content of the Yosida-Hewitt decomposition (see 



16 



GORDAN ZITKOVIC 



Yosida and Hewitd (|l952h ) that each Q E ha.{0, Pk)+ can be uniquely decomposed 



as Q = Q'' + with e ha.{0, P„) + , where Q"^ is a ci-additive measure, and 

is purely finitely-additive. 

Having defined the ambient space ba(C', P^), we turn our attention to the defini- 
tion of the set 1?^ which will serve as a building block in the advertised enlargement 
of the set M^. Let be the polar of in L°°(0,P„), and let be the 

polar of {Mk)° (the bipolar of i.e. 

{M.r ^{ceh°-{0,P^) : (c,Q) < 1, foraUQeXJ. 

I?„^{CQeba(0,P,) : (c,Q> <1, for aU c e (Al , 

and we note immediately that C ba(C',PK)+, because {Mk)° contains the 
negative orthant -L^(0,P„) of L°°(e',P„). 
Finally, for y > we define 

M.{y) = {CQ : e e [0, y], QeM.}, and ^ {yQ : Q E . 

Observe that A4ii{y) C 'D^{y) for each y > 0. Even though A^„(y) will typically be 
a proper subset of 'Dii{y) for any y > 0, the following proposition shows that the 
difference is, in a sense, small. 

Proposition 3.2. For y > 0, M^iy) is cr(ba(C',P„),L°°(0,PK))-dense in V^{y). 

Proof. It is enough to provide a proof in the case y — \. We start by showing that 
^^(l) is contained in the cr(ba(0,P«),L°°(C',P«)) - closure C1(7W^ - ba(C,P^)+) 
of the set Mk — ba(C',PK)+, where 

- ba(0, P«)+ ^ {Q - Q' : Q e Q' e ba(0, PJ+} . 

Suppose, to the contrary, that there exists Q* G T^k{^) \ G\{M.n — ba(C',PK)+). 
By the Hahn-Banach theorem there will exist an element c* e L°°(C', P^), and con- 
stants a < fosuchthat (c*,Q*) > & and (c*,Q) < a, foraUQ e C1(A1„ - ba(0,P„)+). 
Since A^k ~ ba(0,P„)+ contains all negative elements of ba(C',PK), we conclude 
that c* > 0, P^-a.s. and so, < a. Furthermore, the positivity of b implies that 
Pk[c* > 0] > 0, since the probability measures in A4„ are equivalent to P^. There- 
fore, < a < 5, and the random variable ^c* belongs to (A^k)°- It follows that 
(c*,Q*) < a, a contradiction with fact that (c*,Q*) > b. 

To finalize the proof we pick Q e T>'^{1) = {Q e X'k(I) : (1, Q) = 1} and take a 
directed set A and a net {^a)aeA in A^k — ba(C',PK)+ such that Q- Such 

a net exists thanks to the result of the first part of this proof. Each Qq, can be 
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written as Qc = Q^" - Q+ with Q^- e Al„ and Q+ e ba(C', P«,)+, for all a e A. 
Weak-* convergence of the net Qq implies that (1, Qj) and therefore ^ 
in the norm- and weak-* topologies. Thus — > Q and we conclude that A^^ is 
dense in It follows immediately that A^k(1) is dense in D 

3.2. The space . Let V;f^ stand for the vector space of all optional random 
processes {ct)te[o^T] verifying 

||c||a^ < oo, where ||c||7n = sup (|c| ,Q). 

It is quite clear that || • \\m defines a norm on . We establish completeness in 
the following proposition. 

Proposition 3.3. {V{^ ,\\ ■ \\m) is a Banach space. 

Proof. To prove that is complete under || • ||^, we take a sequence (c„)„gN 
in such that J2n \\cn\\M < oo- Given a fixed, but arbitrary & A^k, the 
inequality ||c||a^ > (|c|,Qk) holds for every c £ and thus the series X^^i l^nl 
converges in h^{0, Qk,)- We can, therefore, find an optional process cq G L^(Qk, O) 
such that Co = lim„^oo X]fc=i '^k, m L-'^(Q„,C') and Q^-almost surely. 
For an arbitrary G A^k we have: 

n oo oo 



fc— 1 /e— n-t-l /c— n+1 



By taking the supremum over all E -Mk, it follows that cq G V''^ and X^fc^i Cfc = 
Co in II • \\m- □ 



Rema rk 3.2. A norm of the form 1 1 • 1 1^ has first appeared in lDelbaen and Schachermavei 
(|l997l ) , where the authors study the Banach-space properties of the space of work- 
able contingent claims. 

At this point, we can introduce the third (and final) update of the notation of 
p.2p . Let denotes the set of nonnegative elements in V^. For c G a 
constant y > and Q £ 'D^{y), we define 

(c,Q) ^sup{(c',(Q) : c'eL°°(0,P«) + , c' < c P„-a.s.} . (3.3) 

Proposition 13.21 implies that (c, Q) < ?;||c||7vi < oo for any Q £ 'D^{y). We can 
therefore extend the mapping (•, •) to a pairing (a bilinear form) between the vector 
spaces Vf^ and ba^, where ba^ is defined as the linear space spanned by 1?^, i-e. 

ba^ = {Q e ba(0, P„) : 3 y > 0, Q+, Q- e V^{y) such that Q - Q+ - Q"} . 
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The linear space ba^ plays the role of the ambient space in which the dual domain 



will be situated. It will re p lace t he space ba appearing in ICvitanic et alJ (j200lh 



and 



Karatzas and Zitkovid (|2003l ). and allow us to deal with unbounded random 



endowment and the stochastic clock. 

In this way the action (■,Q) defined in (|3.3p identifies Q G ba^ with a linear 
functional on (V^, || • \\m), and by the construction of the pairing (•,•), the dual 
norm 

IIQ|lbaA.= sup |(C,Q)| 

ceV;^ : ||c||^<l 

of (Q) e 'D^{y) (seen as a linear functional on V^) is at most equal to 2y. We can, 
therefore, identify ba^ with a subspace of the topological dual of and ^^{y) 
with its bounded subset. Moreover, by the virtue of its definition as a polar set of 
(A^k)°, T^k{v) is closed in ba"^ in the aihai^ , V;f^)-topology, so that the following 
proposition becomes is a direct consequence of Alaoglu's Theorem 

Proposition 3.4. For every y > 0, is a (ba^,V;f^)- compact. 

Finally, we state a version of the budget-constraint characterization of admis- 
sible consumption processes, rewritten to achieve a closer match with our newly 
introduced setup. It follows directly from Propositions 12.21 and 13.21 

Proposition 3.5. For any y > 0, a; G M and a nonnegative optional process 
(ct)tg[o,T]; have the following equivalence 

c e Aix, £) ^ y{c, Q)<xy+ (e, Q) for all Q G V,{y), 

where £t — Jq e„ c?k„. Moreover, to check whether c G A{x,£), it is enough to show 
y{c, Q)<xy+ (e, Q) for all Q G M^iy) only. 

4. The Dual Optimization Problem and the Main Result 

4.1. The Convex Conjugate V and Related Functionals. We define a convex 
functional V : ba'^ — > (— oo,cxd], by 

V(Q)^ sup (u(c)-(c,Q)), (4.1) 



cev^ 

and call it the convex conjugate of V. The functional V will play the central 
role in the convex-duality treatment of our utility-maximization problem. 

By strict concavity and continuous differentiability of the mapping x t-^ U {lo, t, x), 
there exists a unique random field / : x [0,T] x (0,cx)) that solves the equa- 
tion Ux{uj,t, I{LL},t^y)) — y. Using the random field /, we introduce a functional 
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I, defined on and taking values in the set of strictly positive optional process, by 
I{Y)t{uj) = I{uj,t,Yt). The functional I is called the inverse marginal utility 
functional. We note for the future use the well-known relationship 

U{iJ, t, /(w, t, y)) = t, y) + yI{LO, t, y), {cj, t,y)enx [0, T] x (0, oo), (4.2) 

where V is the convex conjugate of the utility random field U, defined by 
V{iu,t,y) ^ snp^^o[U{^,t,x) - xy], for {u;,t,y) e 1] x [0,T] x (0,oo). 

For a function f : X M with an arbitrary domain X, taking values in 
the extended set of real numbers M = [—00,00], we adopt the standard notation 
Dom(/) = {x e X : f{x) E (-00,00)}. 

The following proposition represents the convex conjugate V in terms of the 
regular part of its argument , relat ing t he definition (|4.1l) to the corre sponding for- 
mulations in 



Cvitanic et al 



POOII ) and lKaratzas and Zitkovid pOOSf) . 



Proposition 4.1. The domain Dom(V) of the convex conjugate V 0/ U satisfies 



Dom(V) C ha^, and Dom(V) + ba^ C Dom(V). For Q e Dom(V), we h 



we nave 



V(Q) = V(Q''), where G ba^ is the regular part of the finitely-additive measure 
Q. Moreover, there exists a non-negative optional process Y^, such that 

V{Q)=E r Vit,YP)d>,f (4.3) 







When Q is countably-additive, the process (i^f''^)tg[o.T] coincides with the synony- 
mous martingale defined in Proposition \3 . 1\ 



Proof. For Q ^ hsL^ , there exists an optional set A such that q = — Q[v4] > 0. For a 
constant e > 0, we define a sequence (c")„gN of optional processes by c" = e + uIa- 
Let G being the constant from Definition 12.31 (l)fb). Then 

V(Q) > U(c") - (c", Q) > E /" Uiuj, t,e)dKt-e + nq>G-e + nq 00, 

Jo 

yields V(Q) = 00, and so Dom(V) C ba^. To show that Dom(V) + ba:^ C 
Dom(V) we only need to note that it follows directly from the monotonicity of V. 

For the second claim, let Q e ba^ and let Sing(Q) denote the family of all 
optional sets AC [0,T] x f2 such that Q''(A) = 0, where denotes the singular 
part of the finitely-additive measure Q. For A e Sing(iQ), (5 > 0, and an arbitrary 
c e Vrj^, we define an optional process c = c^^'^^ by c = cIa + (5cl^c. Excluding 
the trivial cases when U(c) = —00 or U(c) = +00, we assume U(c) e M, so that 
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Assumption 12.41 implies that U((5c), U(c) e M, as well. Now 

U(c)-(c,Q'-)-U(c) + (c,Q) = 

rT (4.4) 
E / (t/(i,ct)-C/(t,<5ct))lA=dKt-(l-<5)(cl^c,Q'^)+<5(c,Q^). 







According to iBhaskara Rao and Bhaskara Rad (jl983l ) (Theorem 10.3.2, p. 234) 



Sing(QK) contains sets with the P„-probability arbitrarily close to 1, so we can 
make the right-hand side of the expression in (|4.4p arbitrarily small in absolute 
value, by a suitable choice of A e Sing(Q) and 5. It follows immediately that 

V(Q'^) = sup [U(c) - (cQ'-)] < sup [U(c) - (c,Q)] = V(Q), 

and the equality V(Q) ~ V(Q'') follows from the monotonicity of V. 

Note further that Q*" is a countably-additive measure on the cr-algebra of optional 
sets, absolutely continuous with respect to the measure P„. It follows by the Radon- 
Nikodym theorem that optional process {yt^)te[Ci,T] defined by 

rQ(i, c^) = satisfies (c, Q"") - E / ctY^ d^f (4.5) 

uitk Jo 

Let us combine now the representation (|4.5p with the fact that V(Q) — V(Q^). 
By the definition of the convex conjugate function V, 
V(Q) = V(Q'-) = sup (U(c) - icQl) 

= sup E /" (u{t, c{t)) - c{t)Yp) dKt<E [ V{t, Yp) dm 

ceV^ Jo ^ ^ Jo 

The reverse inequality follows from the differentiability of the function V{t,-) by 
taking a bounded sequence in converging to —-^V{t,y) monotonically, in the 
supremum defining V((Q)^). □ 



Remark 4.1. The action of the functional I can be extended to the set of all 



ba^ satisfying Y^ > P„-a.e. by I{Q)t = I(F^)t, obtaining immediately I( 



4.2. The Dual Problem. The convex conjugate V will serve as the main ingredi- 
ent in the convex-duality treatment of the Primal Problem. We start by introducing 
the Dual Problem, with the value hmction v: 

v{y) ^ inf V^(Q), y e [0,(X3), where V^(Q) ^ V(Q) + (e,Q). (4.6) 
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For y < we set v{y) = +00, and note that v{0) < 00 precisely when the utihty 
functional U is bounded from above. 

4.3. The Main Result. Finally we state our central result in the following the- 
orem. The proof will be given through a number of auxiliary results in Appendix 
A. 

Theorem 4.2. Let the financial market (S'^ )jg[o^T] > * = be arbitrage-free 

as in Assumvtion \2.l[ and let the random endowment process {£t)t(=[o,T] admit a 
density (et)tg[o,T] so that Et — j^eudnu, where (Kt)te[o.T] G is a stochastic 
clock. Let U be a utility random field as defined in \ 2.S\ and U the corresponding 
utility functional. If JJ satisfies Assumption \2.4\ and the value function u satisfies 
A ssumption 1 2. ffl then 

(1) the concave value function u(-) is finite and strictly increasing on {—C{£), 00), 
and u{x) — —00 for x < —£{£), where C{£) = iniq^M K^[£t] denotes the 
lower hedging price of the contingent claim £t ■ 

(2) lima,^(_£(£))_|_ ~ +00 and Vmix^oo u' (x) — 0. 

(3) The dual value function v{-) is finitely valued and continuously differentiable 
on (0, 00) and v{y) — +00 for y < 0. 

(4) liiay^o+ v' (y) ^ -00 and liiay^^v'{y) = -C{£). 

(5) For any y > 0, there exists a solution to the Dual problem |^.^ - i.e. 
v{y) = V(Q2^) + (e, Qy), for some Qy £ V^{y). 

(6) For X > —C{£) the Primal Problem has a solution {ct)ti^[o,T]j unique dn- 
a.e. 

(7) The unique solution (cf)4g[o,T] 0/ the primal problem is of the form cf = 
I(Q^)t where is a solution of the dual problem corresponding to y > 
such that X = —v'{y). 

4.4. A Closer Look at the Dual Domain. Given that the solution of the Primal 
problem can be expressed as a function of the process {Yt^)t<£[o,T] from Proposition 
14. 1[ it will be useful to have more information on its probabilistic structure. When 
Q G A^K, Proposition 13.11 implies that is a nonnegative cadlag martingale. In 
general, we can only establish the supermartingale property for a (large enough) 
subclass of (P^-a.s. Vmaximal processes in jy^ : Q e In the contrast with 
the case studied in iKaratzas and Zitkovig (j2003[ ) , we cannot establish any strong 



trajectory regularity properties such as right-continuity, and will only have to satisfy 
ourselves with the weaker property of optional measurability. 
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Proposition 4.3. For Q G 2^(1) there exist an optional process (^t)te[o.T]; taking 
values in [0, 1], and Q' e such that 

(1) = y«>,, 

(2) The process {Y^ )te[o,T] has a dn-version which is an optional supermartin- 
gale, and 



(3) there exists a sequence of martingale measures 
Y^' , dn-a.e. 



such that 



Proof. We start by observing that E[/q YPc{t)dnt] < (c, Q) < 1, for all c e 
Ail,0) . In other words, Y^ is in the P^- polar set of A{1,0), in the terminol- 
ogy of iBrannath and Schachermaved (jl999r ). By characterization in Proposition 
3.51 A(l, 0) can be written as the polar of Ai^., and the Bipolar Theorem of 
Brannath and Schachermaven ( 19991 1 states that Y^ is an element of the smallest 
convex, solid and closed (in PK-probability) set containing A^^. Therefore, there ex- 
ists a process (^t)tg[o,T]j taking values in [0, 1], and an optional process (yt)tg[o.T]j 
(PK-a.s.)-maximal in the bipolar of Mk., such that Y^^ — YfFt. Moreover, the 
same theorem implies that there exists a sequence {Q''"'}neN in A^, and a sequence 
{F(")}„gN of optional processes taking values in [0, 1], such that Y^^ '^t'"'' Yt: 
Pk a.s. The sequence o f positive proces ses Y^'' ' is bounded in L^(Pk) and thus the 
theorem of Komlos (see lSchwarta (jl986[ )) asserts existence of a nonnegative optional 
process (yt)tg[o,T]j a-nd a sequence of finite convex combinations of the elements of 
the sequence {Q(")}„eN (stiU denoted by {Q(")}„eN) such that Ft*^'"' Yt P«-a.s. 
It is now a simple consequence of Fatou's lemma that Y is an element of the bipolar 
of A^K dominating Yt. Since Yt is maximal, we conclude that Yt — Yt P^-a.s. The 
supermartingale property of (y)tg[o,T] follows from Fatou's lemma applied to the 
sequence {(yt*^* ' )tG[o,T]}neN- 

We are left now with the task of producing Q' e 2?(1), such that Yt — Y^ . In 



order to do that, take Q' to be any cluster point of the sequence {Q^"'}neN in 
in the cr (ba^, V^)-topology. Exis tence of such a Q' is g uaranteed by Proposition 
3.41 Finally, it is a consequence of (jCvitanic et alj (|2001r ). Lemma A.l, p. 16) that 
Yt = y,Q'-P,-a.s. □ 
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5. An Example 

In order to illustrate the theory developed so far, in this section we present an 
example of a utility-maximization problem with a random clock given by the local 
time at of an Ornstein-Uhlenbeck process. 

5.1. Description of the Market Model. Let {Bt,Wt)t<£lo,oa) be two correlated 
Brownian motions defined on a probability space (f2, JF, P), and let {^t)te[o.oo) be 
the filtration they generate, augmented by the P-nuU sets in order to satisfy the 
usual conditions. We assume that the correlation coefficient p E (—1, 1) is fixed so 
that d[B,W]t = pdt. 

The financial market will consist of one riskless asset 3^=1, and a risky asset 
(S't)tg [o,oo) which satisfies 

dSt ^ St[p,dt + a dBt^ , So ^ sq, 

where G M is the stock appreciation rate and cr > is the volatility. 

Apart from the tradeable asset (>S't)tg[o,oo)i there is an Orstcin-Uhlenbeck process 
(i?t)tg[o,oo) defined as the unique strong solution of 

dRt = -aRt dt + dWt, Ro = 0. 

We call (-Rt)te[o,oo) the index process, and interpret it as the process modelling 
a certain state-variable of the economy, possibly related to the political stability, 
or some aspect of the goverment's economic policy. The index process is non- 
tradable and its role is to impose constraints on the consumption: we are allowed 
to withdraw money from the trading account only when < e. An agent with 
an initial endowment x and a utility random field [/(•, •, •) will then naturally try 
to choose a strategy so as to maximize the utility of consumption of the form 

E / C/(L^,t,c(t))l{|^,|<,}dt, (5.1) 
Jo 

on some trading horizon [0,t]. If we introduce the notation Kf = l^^n^^^^^ dt, 
the expression in (|5.ip becomes (up to a multiplicative constant) 

E [ U{u,t,c{t))dKl (5.2) 
Jo 

Assuming that e is a small constant, the process can be approximated by the 
local time Kt of the process Rt- We define the time horizon t ~ ti, where Tg = 
inf {t > : Kt > s} is the inverse local time process. In this way our agent will 
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get exactly one unit of consumption time (as measured by the clock k) from the 
start to the end of the trading interval. It will, therefore, be our goal to solve the 
following problem, defined in terms of its value function u{-): 

n 

u{x) = sup E / U{iLj,t,ct) dnt, x > 0. (5.3) 
ceA(,x,a) Jq 

5.2. Absence of Arbitrage. The time-horizon r defined above is clearly not a 
bounded random variable, so the results in the main body of this paper do not 
apply directly. However, in order to pass from an infinite to a finite horizon, it is 
enough to apply a deterministic time-change that maps [0, oo) onto [0, 1) and note 
that no important part of the structure of the problem is lost in this way (we leave 
the easy details of the argument to the reader). Of course, we need to show that 
all the assumptions of Theorem 14.21 are satisfied. The validity of Assumption 12.91 
will have to be checked on a case-by-case basis (see Remark 15.11 for the case of 
log-utility). Therefore, we are left with Assumption 12.11 In order to proceed we 
need to exhibit a countably-additive probability measure Q equivalent to P such 
that the asset-price process {St)t<£lo,oo) is a Q- local martingale on the stochastic 
interval [0, ti]. The obvious candidate will be the measure Qo defined in terms of 
its Radon-Nikodym derivative with respect to P, by 

^ = Z"^^, where Z"^^ ^ exp(-0B., - lo^,), (5.4) 

and 9 = II / (7 is the market price of risk coefficient. Once we show that EfZ° 1 = 1 , 
it will follow directly from Girsanov's theorem (see iKaratzas and Shrevd (jl99lh . 
Theorem 3.5.1, page 191.) that (S')fg[o.oo) is a Q-local martingale on [0,ri]. The 
equivalence of the measures Qq and P is a consequence of the fact that ti < oo 
a.s, which follows from the following proposition which lists some distributional 
properties of the process (i?t)tG[o.oo) and its local time (Kt)tg[o,oo)- 

Proposition 5.1. For ^ < and x > 0, let H(^{x) denote the value of the Hermite 
function 

1 r°° 

^«('^^^2fR)i, (5.5) 
For the Ornstein- Uhlenbeck process (-Rt)tg[o,oo) o.i^'d the inverse (ts)s£[q,oc} of its 
local time at (Kt)te[o,oo)) we have the following explicit expressions: 
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(1) 



i[exp(-Ar,)|i?o = 0] = 



exp(— s?/'(A)), A > —a 



oo, 



A < -c 



where the Laplace exponent '(/'(A) is given by 
V'(A) = a 



(2) With To = inf {i > : Rt ^ 0} we have, 



where 



i[exp(-ATo)|i?o =r] =j(A,| 



■^^ ^ r(i) --\V2J 



(5.6) 



(5.7) 



(5.8) 



Proof. See 



Borodin and Salminen 



Borodin and Salminen 



(|2002D . equation (2.0.1), page 542, for (1), and 
(|2002D . equation (4.0.1), page 557 for (2). Use the identity 

To prove the equahty E[Z° ] = 1, it will be enough to show that E[exp(i0^Ti)] < 



oo by the Novikov's criterion (jKaratzas and Shrevd (|l99l[ ). Proposition 3.5.12., 
page 198.) Part (1) of Proposition l5.1l impHes that for a > 6*^/2, we have E[exp(i0^Ti)] < 
oo, which proves the following proposition: 

Proposition 5.2. When a > 9'^ /2, there is no arbitrage on the stochastic interval 

[0,Tl]. 

5.3. The Optimal Consum ption and Portfolio Choice. It has been shown in 
Karatzas and Zitkoviq (|2003r ) that the maximal dual processes in the context of the 
financial markets driven by Ito processes with bounded coefficients are in fact local 
martingales, and their structure has been described. This result can be extended 
to our case as follows. 



Theorem 5.3. Let the utility random field U satisfy Assumptions \2~^ and \ 2.9[ 

Then, for a; > 0, there exists a predictable process (i^f )tg[o,oo); such that the P^- 
a.e. unique solution (cf )(g[o.oo) of the problem posed in !i5.3\) is given by cf (w) — 
I{uj,t,Zf (ti^)). The process {Z^ )tg[o.oo) o, local martingale satisfying 



dZf = Zf (y^ dWt -{e + pvt) dBt) , Zf - 



(5.9) 
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where y > is the unique solution of —v'{y) ~ x. The portfolio process (ti"? )te[o,oo) 
financing (P)tg[o,oo) O'^d the process (i^f )tg[o.oo) are given by 

1 



(5.10) 



where (-^^OtGlo.oo) «s i/ie wealth process corresponding to (Ti'f )tg[o,oo) ^'^'^ (c?^)te[o,oo); 
given by 



dXt = TTf dSt - Cf dut, Xo = X, 
and (V'^)te[o,oo) (in-d ('0^)ie[o,oo) ore predictable processes such that 



xy + 



i=Y dWt 



C^dKt. 



(5.11) 



(5.12) 



10 Jo Jo 

Proof. By Theorem 14. 2 [ there exists a P^-a.e. unique optimal consumption den- 
sity P G ^(a:,0) given by = /(i,^*^), for some Q G I?,(y). Since (rt^)te[o,oo) 
solves the dual optimization problem, and is therefore P^-a-e. maximal, Proposi- 
tion 331 states that there exists a sequence {Q'-"-'}„gN in Ai such that yQ*"' 

a.s. By taking a furthe r sequence of c o nvex combinatio ns which exists thanks 



to Komlos's Theorem fsee iKomlod (ll967(), ISchwarta (Il986l )). we can assume that 



-a.s. and 



X A-a.e. Without going into te- 



dious but straightforward details, we note that it is the consequence of conti- 
nuity of local m artingales on Brownian filtrations, the Filtered Bipolar Theorem 
( Zitkovic ( 2002), Theorem 2) , and Lemma 2.5, Theorem 2.10 and Proposition 4.1 in 
Karatzas and Zitkovig ( 2003 ). that {yP)i^[q ,^) possesses a P^-version of the form 



Yf = yZ^ , where Z"^ is a local martingale of the form 

Knowing that P G A{x, 0), there exists a portfolio process (jrf )tg[o,oo) such that 
the wealth process (Xt)te[o.oo) given by (|5.1ip satisfies X^ > 0. The saturation of 
the budget constraint (see Lemma fA.3[ (2)) forces Xr-^ = 0. Ito's Lemma shows 
that the process 

Ah^XtZ-, + f ZlcldK^ (5.13) 
Jo 

is a non-negative local martingale with = J^^ Z^c^dKu- Bv Lemma lA.3l (2). we 
havcE[A/T-j] ^ X — Mq. Therefore, M is a martingale on [0,ti]. The second equality 
in (I5.10|l follows by applying Ito's formula to (|5.13p . and equating coefficients with 
the ones in the expansion (|5.12p . □ 
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5.4. The Case of Logarithmic Utility. In order to get explicit results, we con- 
sider now the agent whose utility function has the form U{uj, t, x) — exp(— /3t) log(x), 
where the impatience rate /3 is a positive constant. The expressions (j5.10p will 
prove indispensable because it is possible to get an explicit expression for the pro- 
cesses (V't^)tG[o,oo) and (V'?)te[o,oo) from (|5.12p . The key feature of the logarithmic 
utility that will allow us to do this is the fact that the inverse marginal utility 
function / is given by I{t,y) — exp{—/3t)/y, so that the right-hand side of (|5.12[) 
becomes 



Mr,^ Z^c^dnt^ e~f^'dKt. (5.14) 
^0 Jo 

In order to progress with the explicit representation of the processes (V't^)tG[o,oo) 
and (V'^)te[o,oo) from (j5.12p . in the following lemma we prove a useful fact about 
the conditional /3-potential of the local time (Kt)tg[o,oo), i-e. the random process 
(Gt)fe[o,oo) defined by Gt = Ef/J"' exp{-Pu) dKu\Tt]. 

Lemma 5.4. A version of the process G is given by 

'exp(-/3t)j(/3, |i?d)i^^^^^2i(^ii^i)MM + /J e-^« dn^, < 1 
Jq'^ e~'^'" dKu, Kt>l, 
where the functions ip and j are defined in |5. ?| ) and I15.8\) . 



Gt = { 



(5.15) 



Proof. We start by defining a family of stopping times T'o(t) = inf {u>t: i?„ = 0}, 
and note that because duu does not charge the complement of the zero-set of Rt , 
we have 

e-f^^dKu. (5.16) 



Gt^E[f ' e~'^''dKu 


cr{Kt,Rt)] + 


I 


JToit) 







The replacement of the u-algebra J-t by a{Kt,Rt) is permitted by the Markov 
property of the process (kj, Rt). 

When Kf > 1, the value of Gt is trivially given by (|5.15p . so we can restrict our 
attention to the value of the function g{t, r, k) — E[J'^^^^j^ e~^'^ dKu\i^t — k, Rt — r] 
for fc < 1, because then (|5.16p implies that Gt ~ g{t, Rt, Kt) + Jq Gxp{— (3u) dKu 
on {nt < 1}. Using again the strong Markov property and time-homogeneity of 
(/if, Rt) we obtain 



ri 



git, r, k) = E[e-'^^°(*) / e-''("-^"(*» duu Rt ^r,Kt^ k] 



e 



''*E[e-'3^«("' Ro =r]E[ e'l^'dnt Rq = 0, = 0] 







(5.17) 
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The second term in the above expression is given in (15. 8p . As for the third term, a 
change of variables yields 

e-P'dn^] = / E[e-^-"] du = — (5.18) 

Jo iAP) 

□ 

We have developed all the tools required to prove the following result 

Proposition 5.5. In the setup of Theorem \5.°A set U{u!,t,x) = exp(— /3i) log(a;). 
Then we have the following explicit representations of the processes (Trf )tg[o,oo)7 
('^f)te[o,oo) and (cf )tg[o,oo) • 

= -sgn{Rt)hr-^) where h{z)^-^ ° , (5.19) 

V ^2 ' OL H_£ (z) 

< = ^^{e + psgniRt)hi\Rt\/V2)), (5.20) 

Finally, the process (t'f )tg[o,T] bounded and so the optimal dual process {Z^ )te[o.T] 
is a martingale. 

Proof. A use of the Ito-Tanaka formula and the expression (|5.15[) yields 

V^f = 0, and = eM-Pt) sgn(i?,)|:j(/?, | ^ ' ^^PHj^- ^0^(/3)) _ 

(5.22) 

Moreover, the martingale property of process Mt from (|5.13p implies that XtZ^" = 
Gt — /q e"''" dKu, and so, equations (|5.8p . (|5.10p and (|5.12p can be combined into 
the following explicit expression of the optimal dual process 

n = sgn(j?t ^ IP h ■ 
\Rt\) 



The r epresentation (|5.8p and the identity -g^H^{x) — 2^H^^i{x) (see iLebedev 
(11972), equation 10.5.2, page 289) complete the proof of ^J^. 

Part (7) of Theorem SJI and the identities ((SlO)) and (|02)) imply that 

* yj-(A|i?t|)(l-exp(-(l-«:0*(/3)))' 
where y satisfies x — —v'{y). To get a more explicit expression for y, we combine 
(|5.14p and (|5.12p to get xy = ]E[JJ^^ exp(— /3t) d^t]. After repeating the calculation 
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in (I5.18P with k = 0, we only need to rearrange the terms and remember that 
Rt ~ dn-a.c, to obtain ()5.2ip . 

We are left with the pro of of the bound edness of the process (I'f )tg[o,oo)- The 



asymptotic formula 10.6.3 in lLebedevI (jl972f ). page 291, implies that, H^{x) ^ C^x^ 



as X — !■ oo, for some positive constant depending on ^ < 0. Therefore, there 
exists a constant D > such that h{x) ~ Dx^^, as x oo. Because of the existence 
of the limit \imx^o+ h(x) , we conclude that /i is a bounded function on [0,oo). 
Hence, (j^f )tg[o,oo) is a bounded process, making [Z^ )te[Q,T] a martingale. □ 



Remark 5.1. In the generic setup of Theorem [531 "^6 have explicitly assumed that 
u(x) < oo, for at least one x > 0. In the case of the logarithmic utility random 
field treated above, the validity of such an assumption is implied by the following 
chain of inequalities in which Qo and Z^^ are as in (|5.4|) . 

u{x) -x= sup (U(c) -x)< V(Qo) = E / (-1 - log(^f°)) dut 

ci£A{x,0) Jo 

<E[r hoB^ + l + 0h)dKt]^l- f\[0{l + Bl) + 0^Ts]ds (5.23) 
Jo ^ ^ Jo 

9 (6*2 + 1) ^ ^ , + (0-2 + i)e\ti] 
< - + -^^ — / IE[t,,] ds < — Z < oo. 

Jo 



2 

The fact that E[ri] < oo (which can easily be deduced from (|5.6[) ) implies both the 
final inequality in (|5.23p and t he equality E[i?^J = E[ri] t hrough Wald's identity 



(see Problem 2.12, page 141 in lKaratzas and Shrevd (|l991l) ) 



Appendix A. A Convex-Duality Proof of Theorem 14.2 



We have divided the proof into several steps, each of which is stated as a separate 
lemma. Throughout this section all the conditions of Theorem 14.21 are assumed to 
be satisfied. 

Lemma A.l (Global properties of the value functions). The value function u{-) 
is convex, non- decreasing and [—00,00) -valued, while v is concave, and (—00,00]- 
valued. Moreover, the primal and the dual value functions u{-) and v{-) are convex 
conjugates of each other. 



Proof. 

(1) Concavity of u(-) and convexity of v{-) are i nherited from the propertie s 
of the objective functions U(-) and V(-) (see lEkeland and TemamI ([1999), 
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the proof of Lemma 2.1, p. 50, for the standard argument). The increase 
of u(-) follows from the inclusion A{x,£) C A{x',£), for x < x' . 

(2) By the Assumption 12.91 there exists a; e M such that u{x) < oo. It follows 
immediately, by concavity of u{-) that u{x) < oo for all x e M. 

(3) To establish the claim that v{-) is the convex conjugate of u(-), we define 
the auxiliary domain A'{x,£) = A{x,£) \ Ux'<xA{x' ,£). Note that 

(a) the monotonicity of the utility functional U(-) implies that 

sup U(c) — sup U(c), and 

ceA{x,£) ceA'{x,£) 

(b) the Proposition 12.21 implies that supQgx)„(j^)(c — e,Q) — xy, for any 
y > 0, and c G A'{x,£). 

Having established the weak-* compactnes s of the dual domain T>,^{y) in 



the Minimax Theorem (see ISionI (jl958t )) implies that 



sup[u(x) — xy] — sup I sup U(c) — xy 

xGR xeR^ ceA'{x,£) 



sup sup (U(c)— sup (c — e, 

xeR ci£A'{x,£) ^ QeV^iy) 

sup sup inf (U(c) — (c, Q) 

xeR ceA'{x,£)'Q&'^''iy) ^ 



sup inf ( U(c) 



inf sup fu(c) - (c,Q) + (e,( 



+ 



inf (v(Q) + {e,Q)) =v{y). 



□ 



Lemma A. 2 (Existence in the dual problem). For y e Dom(ti) there exists G 
T^K,{y) such that 

v{y)=Y^(r)=^{m + {e,m- 

Proof. For y e Dom(v), let (Qri)neN be a minimizing sequence for v{y), i.e. a 
sequence in !?„(?/), such that (V^(Q„))„gN is real- valued and decreasing with limit 
v{y). Since Vf^[y) is a closed and bounded subset of the dual [V-j^)* of . By 
Proposition l3.4l the product space ^^{y) x [v{y), V^((Q)i)] is compact. Therefore the 
sequence (Q„, V^(Q„))^^gj^ has a cluster point iQ\v*) in V,{y) x [t>(y), (Qi)]. 
By the decrease of the sequence (V^(Q„))„gN, we have v* = lim„ V^((Q)„) ~ v{y). 
On the other hand, by the definition (|4.ip of the functional V(-) , the epigraph 
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of its restriction V'^(-) : M is closed with respect to the product of the 

weak-* and Euclidean topologies. Therefore, (Q^,i;*) is in the epigraph of and 
thus, v{y) ^v* > Y^iQy) = Y{Qy) + {Qy,e). □ 

Lemma A. 3 (Consequences of Reasonable Elasticity). 

(1) Dom(i;) = {0,oo). 

(2) v{-) is continuously differentiable, and for y > its derivative satisfies 

yv'iy) = -{{Qyy ,my)) + {e,Qn, 

where G 'D^{y) is a minimizer in the dual problem, i.e. v{y) = V^(Q''). 

(3) The following inequality holds for all Q G V^iy) 

y^;'(^/)>-(Q^W)) + (e,Q^). 

(4) liniy^^o i^'(y) = -oo and limy ^ oc v' (y) e [ infQgTn E'3[fT], supQg^ EQ[£t]] 

(5) my)eA{-v'{y),e) and (I(Q?^), (Q^')'') = (I(Q^),Q^). 

Proof. Thanks to the representation v{y) = E V{t,Y^ )dKt, and the fact that 
E j'^Y^dnt < 1 for aU Q e the proofs of parts (l)-(4) this lemma fol- 

low (in an almost verbatim fashion) the proofs of the following statements in 



Karatzas and Zitkovid (|2003f ): (1) Lemma A. 5, p. 30, (2) Lemma A. 6, p. 31., (3) 



Proposition A. 7, p. 32., and (4) Lemma A. 8, p. 33. 

To prove the claim (5), we observe that the combination of (3) and (4) implies 
that 

(I(Q^),t/Q) < -yv'iy) + {e,yQ), for all Q e M^. 

From PropositionlSHit follows that I{Qy) e A{-v'{y),e), so {I{Qy),Q) < -~yv'{y)+ 
(e,Q), for all Q e V{y). In particular, {I{Qy),Qy) < -yv'{y) + (e,Q?'), yielding 
immediately the inequality (I(Q«),Qy) < (I(Qy), (Q?')'^). The second part of the 
claim follows by the trivial inequality (I(Q^), Q^) > (I(Q^), (Q^)O- ^ 

Lemma A. 4 (Existence in the Primal Problem). For x > ~\imy^oov'{y) the 
Primal Problem 112.5]) has a solution, i.e. there exists (f G A{x^£) such that u{x) — 
U(P). Moreover, the optimal consumption density process c? is P^-a.s. unique. 

Proof. Using the continuous differentiability of the dual value function v{-) and 
Lemma |A.5[ we conclude that for any x > lim,^^oo v' (y) there exists a unique y > 
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such that v' {y) — —x. Let be the solution to the dual problem corresponding 
to J/, and define the candidate solution to the primal problem by 

By Lemma [A. 31 <E A{x,£). The optimality of the consumption density process 
follows from the fact that 

u(c-) - u(i(Q^)) = v{Qy) + (i(Qy),Q^> - v{Qy) + {KQy), {Qyy) 

= v{y) - yv'{y) = u{x), 

using Lemma IA.3I and the conjugacy of u(-) and v{ ). The P^-a.s. uniqueness of 
is a direct consequence of the strict concavity of the mapping x i~-> U{uj,t,x) 
coupled with convexity of the feasible set A{x, £). □ 

Lemma A. 5. liniy^oo v'{y) — C{£), where C{£) = infQg» E''2[£t]- 

Proof. Let x' = Ximy^oo v' {y) . Part (4) of Lemma [A. 31 states that x' > C{£), so 
we only need to prove that x' < C{£). Suppose, to the contrary, that there exists 
xq > C{£t) of the form xq — w'(yo) for some ?/o > so that x' > xq. The optimal 
consumption process {C^^°)t£[Q.T] corresponding to the initial capital —xq exists 
by the Lemma El and satisfies EQ[Cj;"="] < -xo + ¥.^[£t] for any Q e 7W by 
Proposition 12. 21 Taking the infimum over Q e A4 we reach a contradiction 

< inf EQ[C^^«] < -xo + C(£t) < 0. 

Therefore, x' < C{£). □ 
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